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INTERNATIONAL APPLICATION NO. 

PCT/US03/040726 



TRANSMITTAL LETTER TO THE UNITED STATES 
DESIGNATED/ELECTED OFFICE (DO/EO/US) 
CONCERNING A SUBMISSION UNDER 35 U.S.C. 371 



INTERNATIONAL FILING DATE 
19 Dec 2003 



ATTORNEY'S DOCKET NUMBER 
YOR920020375PCT1 



U.S. APPLiqATjpN 
PRIORITY DSacTFCLAlMED 



FR1.5) 



20 Dec 2002 



TITLE OF INVENTION 

SYSTEM AND METHOD FOR ANNOTATING MULTI-MODAL CHARArTFRTSTTHS TN MTTT.TTMF.nT A nnr.TTMF.NTS 



A,PPLICANT(S) FOR DO/EO/US Adams, Hugh W. , Jr.; Iyengar, Giridharen; Lin, Ching-Yung 
Neti, Chalapathy V.: Smith. John R.: Tseng. Belle L 



Applicant herewith submits to the United States Designated/Elected Office (DO/EO/US) the following items and other information: 
|~xl This is a FIRST submission of items concerning a submission under 35 U.S.C. 371 . 
I I This is a SECOND or SUBSEQUENT submission of items concerning a submission under 35 U.S.C. 371 . 



GO This is an express request to begin national examination procedures (35 U.S.C. 371(0). The submission must include items 
(5), (6), (9) and (21) indicated below. 

IZD The US has been elected (Article 31). 

Pxl A copy of the International Application as filed (35 U.S.C. 371 (c)(2)) 

a> is attached hereto (required only if not communicated by the International Bureau). 

b. EE] nas Deen communicated by the International Bureau. 

c. CD is not required, as the application was filed in the United States Receiving Office (RO/US). 
>. [Zl An English language translation of the International Application as filed (35 U.S.C. 371 (c)(2)). 

a. □ is attached hereto. * - r- 

b. CH has been previously submitted under 35 U.S.C. 154(d)(4). 

7. QD Amendments to the claims of the International Application under PCT Article 19 (35 U.S.C. 371(c)(3)) 

a> CH are attached hereto (required only if not communicated by the International Bureau), 
have been communicated by the International Bureau. 

c. ^G9 have not been made; however, the time limit for making such amendments has NOT expired. 

have not been made and will not be made. 

8. An English language translation of the amendments to the claims under PCT Article 19 (35 U.S.C. 371 (c)(3)). 

9. CU An oath or declaration of the inventor(s) (35 U.S.C. 371 (c)(4)). 

10 □ An English language translation of the annexes of the International Preliminary Examination Report under PCT 
Article 36 (35 U.S.C. 371(c)(5)). 

Items 11 to 20 below concern document(s) or information included: 

1 1 . CU An Information Disclosure Statement under 37 CFR 1 .97 and 1 .98. 

1 2. □ An assignment document for recording. A separate cover sheet in compliance with 37 CFR 3.28 and 3.31 is included. 

13. A preliminary amendment. 

14. An Application Data Sheet under 37 CFR 1 .76. 

15. □ A substitute specification. 

16. A power of attorney and/or change of address letter. 

1 7. O A computer-readable form of the sequence listing in accordance with PCT Rule 13ter.2 and 37 CFR 1 .82 1 - 1 .825. 

18. D A second copy of the published International Application under 35 U.S.C. 154(d)(4). 

« .... ^ 

1 9. D A second copy of the English language translation of the international application under 35 U.S.C. 154(d)(4). 

20. Other items or information: 



This collection of information is required by 37 CFR 1.414 and 1.49 1-1.492. The information is required to obtain or retain a benefit by the public which is to file (and by the 
USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1 14. This collection is estimated to ^ « mrn^ 
including gathering information, preparing, and submitting the completed form to the USPTO. Time will vary depending upon themdlvidual ^^^^ SfcTu? 
of time you require to complete this form and/or suggestions for reducing this burden, should ^.^S^^^SS^S^ ItSiSS? SSlD^S m£. sTod PCT 
Department of Commerce, P.O. Box 1450, Alexandria. VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO. Mail Stop PCT, 
Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450. p \tf2 
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U.S. APPLICATI^j 


0 f*$*$¥^&$' 5) | INTER ^ T,ONALAPPL,CATIONNO " 


ATTORNEY'S DOCKET NUMBER 1 


The following fees have been submitted 


* 300 




22. Qf Examinatio 
If International preiimin 
PCT Article 33(1 )-(4 


i fee 

ary examination report prepared by USPTO and all claims satisfy provisions of 


$ 200 




' $200 


23. 5) Search fee 

Searcffiee (37 CFR 1.445(a)(2)) has been paid on the international application to the USPTO as an 


500 

$ 




TOTAL OF 21.22 and 23= , . 


$ 1000.00 




i— 1 Additional fee for specification and drawings filed in paper over 100 sheets (excluding 
' sequence listing or computer program listing filed in an electronic medium). 
ThA f«A is $250 for each additional 50 sheets of paper or fraction thereof. 


$ 




Total Sheets 


Extra Sheets 


Number of each additional 50 or fraction 
thereof (round up to a whole number) 


RATE 


-100 = 


/50 = 




x $250 


Surcharge of $130.00 for furnishing 


1 the oath or declaration later than 30 months from the earliest 






CLAIMS 


NUMBER FILED 


NUMBER EXTRA 


RATE 


$ 




, Total claims 


19 - 20 = 


0 


x $50 


$ o 






, -3 = 




x $200 


$ o 




MULTIPLE DEPENDE 


NT CLAIM(S) (if applicable) 




+ $360 


$ 




TOTAL OF ABOVE CALCULATIONS = 


$ 1000 00 




□ Applicant claims small entity status. See 37 CFR 1 .27. Fees above are reduced by 






SUBTOTAL = 


$ TOOO 00 




Processing fee of $130.00 for furnishing the English translation later than 30 months from the earliest 
claimed priority date (37 CFR 1.492(i)). + 


$ 


^ TOTAL NATIONAL FEE = 


$ 1000.00 1 


Fee for recording the enclosed assignment (37 CFR 1.21(h)). The assignment must be accompanied 
by an appropriate cover sheet (37 CFR 3.28, 3.31). $40.00 per property + 


$ 


TOTAL FEES ENCLOSED = 


$ 1000.00 






Amount to be 
refunded: 


$ | 


Amount to be 
charged: 


$ 



a. 



A check in the amount of $ . 



to cover the above fees is enclosed. 



□ 

b. Q Please charge my Deposit Account No. 50-0510 in the amount of $ 1000.00 to cover the above fees. 
A duplicate copy of this sheet is enclosed. 

c Q The Commissioner is hereby authorized to charge any additional fees which may be required, or credit any overpayment to Deposit 
Account No. 50-0510 . A duplicate copy of this sheet is enclosed. 

d. □ Fees are to be charged to a credit card. WARNING: Information on this form may become public. Credit card information should not 
be included on this form. Provide credit card information and authorization on PTO-2038. 

.137(a) or (b)) must be filed 



NOTE: Where an appropriate time limit under 37 CFR 1.495 has not been met, a petition to Revive (37 C 
and granted to restore the International Application to pending status. 

SEND ALL CORRESPONDENCE TO: 

Customer Number: 47049 
FERENCE & ASSOCIATES 

409 Broad Street 

Pittsburgh, Pennsylvania 

15143 

412 741-8400 - Telephone 

412-741-9292 - Facsimile 




SIGNATURE 

Stanley D. Ference III 



NAME 
33,879 



REGISTRATION NUMBER 



FORM PTO-1390 (REV. 02-2005) 



Page 2 of 2 



IN THE UNITED STATES PATENT 



^539890 

YOR920020375PCT 1 



CERTIFICATE OF MAILING UNDER 37 CFR § 1,10 

Applicant : Hugh W. Adams, Jr. et al. 
Serial No. : Unassigned 
Filed : Herewith 

For SYSTEM AND METHOD FOR ANNOTATING MULTI-MODAL 

CHARACTERISTICS IN MULTIMEDIA DOCUMENTS 

Papers TRANSMITTAL LETTER TO THE DO/EO/US CONCERNING A 

FILING UNDER 35 U.S.C. 37 1 ; RETURN POSTCARD (two) 

"Express Mail" Mailing Label Number 

EV 736793972 US 



Date of Deposit: 



20 June 2005 



I hereby certify that these papers and fee are being deposited with the United 
States Postal Service "Express Mail post Office to Addressee" service under 37 CFR 
§ 1.10 on the date indicated above and is addressed to the Commissioner of Patents 
and Trademarks, Washington, D.C 20231. 

Stanley D. Ference III 



(Typed or print name of person 
mailing paper or fee) 



